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Background 

This application is a continuation of, and claims the benefit of priority of, copending, 
commonly-assigned United States Patent Application Serial Number 10/449,732, filed May 30, 
5 2003, entitled "Virtual Processor Methods and Apparatus with Unified Event Notification And 
Consumer-producer Memory Operations," the teachings of which are incorporated herein by 
reference. 

The invention pertains to digital data processing and, more particularly, to embedded 
10 processor architectures and operation. The invention has application in high-definition digital 
television, game systems, digital video recorders, video and/or audio players, personal digital 
assistants, personal knowledge navigators, mobile phones, and other multimedia and non-mul- 
timedia devices. 

15 Prior art embedded processor-based or application systems typically combine: (1) one 

or more general purpose processors, e.g., of the ARM, MIPs or x86 variety, for handling user 
interface processing, high level application processing, and operating system tasks, with (2) 
one or more digital signal processors (DSPs), including media processors, dedicated to han- 
dling specific types of arithmetic computations at specific interfaces or within specific applica- 

20 tions, on real-time/low latency bases. Instead of, or in addition to, the DSPs, special-purpose 
hardware is often provided to handle dedicated needs that a DSP is unable to handle on a pro- 
grammable basis, e.g., because the DSP cannot handle multiple activities at once or because the 
DSP cannot meet needs for a very specialized computational element. 

25 Examples of these prior art systems include personal computers, which typically com- 

bine a main processor with a separate graphics processor and a separate sound processor; game 
systems, which typically combine a main processor and separately programmed graphics pro- 
cessor; digital video recorders, which typically combine a general purpose processor, mpeg2 
decoder and encoder chips, and special-purpose digital signal processors; digital televisions, 

30 which typically combine a general purpose processor , mpeg2 decoder and encoder chips, and 
special-purpose DSPs or media processors; mobile phones, which typically combine a proces- 
sor for user interface and applications processing and special-purpose DSPs for mobile phone 
GSM, CDMA or other protocol processing. 

35 Prior art patents include United States Patent 6,408,38 1 , disclosing a pipeline processor 

utilizing snapshot files with entries indicating the state of instructions in the various pipeline 
stages. As the instructions move within the pipeline, the corresponding snapshot file entries are 
changed. By monitoring those files, the device determines when interim results from one pipe- 

1 (Background) 



Express Mail Label: US EV 324 849 3 78 US 



line stage can be directly forwarded to another stage over an internal operand bus, e.g., without 
first being stored to the registers. 

The prior art also includes United States Patent 6,219,780, which concerns improving 
5 the throughput of computers with multiple execution units grouped in clusters. This patent 
suggests identifying "consumer" instructions which are dependent on results from "producer" 
instructions. Multiple copies of each producer instruction are then executed, one copy in each 
cluster that will be subsequently used to execute dependent consumer instructions. 

1 0 The reasons for the general prior art approach — combining general purpose processors 

with DSPs and/or special-purpose hardware — is the need to handle multiple activities (e.g., 
events or threads) simultaneously on a real-time basis, where each activity requires a different 
type of computational element. However, no single prior art processor has the capacity to 
handle all of the activities. Moreover, some of the activities are of such a nature that no prior 

15 art processor is capable of properly handling more than a single one of them. This is particu- 
larly true of real-time activities, to which timely performance is degraded, if not wholly pre- 
vented, by operating system intervention. 

One problem with the prior art approach is hardware design complexity, combined with 
20 software complexity in programming and interfacing heterogeneous types of computing ele- 
ments. Another problem is that both hardware and software must be re-engineered for every 
application. Moreover, prior art systems do not load balance: capacity cannot be transferred 
from one hardware element to another. 

25 An object of this invention is to provide improved apparatus and methods for digital 

data processing. A further object of the invention is to provide such apparatus and methods as 
support multiple activities, real-time or otherwise, to be executed on a single processor, as well 
to provide multiple such processors that are capable of working together, A related object is to 
provide such apparatus and methods as are suitable for an embedded environment or applica- 

30 tion. Another related object is to provide such apparatus and methods as facilitate design, 
manufacture, time-to-market, cost and/or maintenance. 

A further object of the invention is to provide improved apparatus and methods for 
embedded (or other) processing that meet the computational, size, power and cost require- 
35 ments of today's and future appliances, including by way of non-limiting example, digital 
televisions, digital video recorders, video and/or audio players, personal digital assistants, per- 
sonal knowledge navigators, and mobile phones, to name but a few. 
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Yet another object is to provide improved apparatus and methods that support a range 
of applications. 

Still yet another object is to provide such apparatus and methods which are low-cost, 
5 low-power and/or support robust rapid-to-market implementations. 
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These and other objects are attained by the invention which provides, in one aspect, an 
embedded processor comprising a plurality of processing units that each execute processes or 
5 threads (collectively, "threads"). One or more execution units are shared by the processing 
units and execute instructions from the threads. An event delivery mechanism delivers events 
— such as, by way of non-limiting example, hardware interrupts, software-initiated signaling 
events ("software events") and memory events — to respective threads without execution of 
instructions. Each event can be processed by the respective thread without execution of 
1 0 instructions outside that thread. 

According to related aspects of the invention, the threads need not be constrained to 
execute on the same respective processing units during the lives of those threads. In still other 
related aspects, the execution units execute instructions from the threads without needing to 
1 5 know what threads those instructions are from. 

The invention provides, in other aspects, an embedded processor as described above 
that additionally comprises a pipeline control unit which launches instructions from plural 
threads for concurrent execution on plural execution units. That pipeline control unit can com- 
20 prise a plurality of instruction queues, each associated with a respective one of the virtual pro- 
cessing units, from which queues instructions are dispatched. In addition to decoding 
instruction classes from the instruction queues, the pipeline control unit can control access by 
the virtual processing units to a resource that provides source and destination registers for the 
dispatched instructions. 

25 

According to other related aspects, among the plural execution units is a branch execu- 
tion unit. This is responsible for any of instruction address generation, address translation and 
instruction fetching. The branch execution unit can also maintain state for the virtual process- 
ing units.. It can be controlled by the pipeline control unit, which signals the branch execution 
30 unit as each virtual processing unit instruction queue is emptied. 

According to other aspects of the invention, plural virtual processing units as discussed 
above can execute on one embedded processor. While, in related aspects, those plural virtual 
processing units can execute on multiple embedded processors. 

35 

Further aspects of the invention provide an embedded processor comprising a plurality 
of processing units, each executing one or more threads, as described above. An event delivery 
mechanism delivers events as described above to respective threads with which those events 
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are associated, without execution of instructions. As above, the processing units can be virtual 
processing units. And, as above, they can execute on one or more embedded processors. 

Embedded processors and systems as described above are capable of executing multi- 
5 pie threads and processing multiple events simultaneously with little or no latency and with no 
operating system switching overhead. Threads can range from real time video processing, to 
Linux operating system functions, to end-use applications or games. As such, embedded pro- 
cessor and systems have application, by way of non-limiting example, in supporting the direct 
execution of the diverse functions required for multimedia or other devices, like a high-defini- 
10 tion digital television, game systems, digital video recorders, video and/or audio players, per- 
sonal digital assistants, personal knowledge navigators, mobile phones, and other multimedia 
and non-multimedia devices 

Moreover, embedded processors and systems as described above enable all functions to 
15 be developed and executed in a single programming and execution environment without the 
need for special purpose hardware accelerators, special purpose DSPs, special purpose proces- 
sors or other special purpose hardware. Where multiple such embedded processors are added 
together, they work seamlessly, providing greater overall capacity including both more execu- 
tion capacity and more concurrent thread handling capacity. The addition of those processors 
20 is transparent from the perspective of both threads and events that are directed to specific 
threads. Load balancing is also transparent, in part, because of the way the processor assigns 
events and threads for processing 

Other aspects of the invention provide digital data processing system having structures 
25 and operating as described above, albeit not in an embedded platform. 

Yet further aspects of the invention provide methods paralleling the operation of the 
systems described above. 

30 These and other aspects invention are evident in the drawings and the description fol- 

lows. 
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Brief Description of the Drawings 

A more complete understanding of the invention may be attained by reference to the 
drawings, in which: 

5 

Figure 1 depicts a processor module constructed and operated in accord with one prac- 
tice of the invention; 

Figure 2 contrasts thread processing by a conventional superscalar processor with that 
10 by a processor module constructed and operated in accord with one practice of the invention; 

Figure 3 depicts potential states of a thread executing in a virtual processing unit (or 
thread processing unit (TPU)) in a processor constructed and operated in accord with one prac- 
tice of the invention; 

15 

Figure 4 depicts an event delivery mechanism in a processor module constructed and 
operated in accord with one practice of invention; 

Figure 5 illustrates a mechanism for virtual address to system address translation in a 
20 system constructed and operated in accord with one practice of the invention; 

Figure 6 depicts the organization of Level 1 and Level2 caches in a system constructed 
and operated in accord with one practice the invention; 

25 Figure 7 depicts the L2 cache and the logic used to perform a tag lookup in a system 

constructed and operated in accord with one practice of invention; 

Figure 8 depicts logic used to perform a tag lookup in the L2 extended cache in a 
system constructed and operated in accord with one practice invention; 

30 

Figure 9 depicts general-purpose registers, predicate registers and thread state or con- 
trol registers maintained for each thread processing unit (TPU) in a system constructed and 
operated in accord with one practice of the invention; 

35 Figure 10 depicts a mechanism for fetching and dispatching instructions executed by 

the threads in a system constructed and operated in accord with one practice of the invention; 
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Figures 11-12 illustrate a queue management mechanism used in system constructed 
and operated in accord with one practice of the invention; 

Figure 1 3 depicts a system-on-a-chip (SoC) implementation of the processor module of 
5 Figure 1 including logic for implementing thread processing units in accord with one practice 
of the invention; 

Figure 14 is a block diagram of a pipeline control unit in a system constructed and oper- 
ated in accord with one practice of the invention; 

10 

Figure 15 is a block diagram of an individual unit queue in a system constructed and 
operated in accord with one practice of the invention; 

Figure 16 is a block diagram of the branch unit in a system constructed and operated in 
15 accord with one practice of the invention; 

Figure 17 is a block diagram of a memory unit in a system constructed and operated in 
accord with one practice of the invention; 

20 Figure 18 is a block diagram of a cache unit implementing any of the LI instruction 

cache or LI data cache in a system constructed and operated in accord with one practice of the 
invention; 

Figure 19 depicts an implementation of the L2 cache and logic of Figure 7 in a system 
25 constructed and operated in accord with one practice of the invention; 

Figure 20 depicts the implementation of the register file in a system constructed and 
operated in accord with one practice of the invention; 

30 Figures 21 and 22 are block diagrams of an integer unit and a compare unit in a system 

constructed and operated in accord with one practice of the invention; 

Figures 23A and 23B are block diagrams of a floating point unit in a system constructed 
and operated in accord with one practice of the invention; 

35 

Figues 24A and 24B illustrate use of consumer and producer memory instructions in a 
system constructed and operated in accord with one practice of the invention; 
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Figure 25 is a block diagram of a digital LCD-TV subsystem in a system constructed 
and operated in accord with one practice of the invention; and 

Figure 26 is a block diagram of a digital LCD-TV or other application subsystem in a 
S system constructed and operated in accord with one practice of the invention. 
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Detailed Description 

Figure 1 depicts a processor module 5 constructed and operated in accord with one 
practice of the invention and referred to occasionally throughout this document and the 
5 attached drawings as "SEP". The module can provide the foundation for a general purpose 
processor, such as a PC, workstation or mainframe computer — though, the illustrated embodi- 
ment is utilized as an embedded processor. 

The module 5, which may be used singly or in combination with one or more other such 
10 modules, is suited inter alia for devices or systems whose computational requirements are 
parallel in nature and that benefit fi*om multiple concurrently executing applications and/or 
instruction level parallelism. This can include devices or systems with real-time requirements, 
those that execute multi-media applications, and/or those with high computational require- 
ments, such as image, signal, graphics and/or network processing. The module is also suited 
15 for integration of multiple applications on a single platform, e.g., where there is concurrent 
application use. It provides for seamless application execution across the devices and/or sys- 
tems in which it is embedded or otherwise incorporated, as well as across the networks (wired, 
wireless, or otherwise) or other medium via which those devices and/or systems are coupled. 
Moreover, the module is suited for peer-to-peer (P2P) applications, as well as those with user 
20 interactivity. The foregoing is not intended to be an extensive listing of the applications and 
environments to which the module 5 is suited, but merely one of examples. 

Examples of devices and systems in which the module 5 can be embedded include inter 
alia digital LCD-TVs, e.g., type shown in Figure 24, wherein the module 5 is embodied in a 

25 systemron-a-chip (SOC) configuration. (Of course, it will be appreciated that the module need 
not be embodied on a single chip and, rather, can be may be embodied in any of a multitude of 
form factors, including multiple chips, one or more circuit boards, one or more separately- 
housed devices, and/or a combination of the foregoing). Further examples include digital 
video recorders (DVR) and servers, MP3 servers, mobile phones, applications which integrate 

30 still and video cameras, game platforms, universal networked displays (e.g., combinations of 
digital LCD-TV, networked infomiation/Intemet appliance, and general-purpose application 
platform), G3 mobile phones, personal digital assistants, and so forth. 

The module 5 includes thread processing units (TPUs) 10-20, level one (LI) instruc- 
35 tion and data caches 22, 24, level two (L2) cache 26, pipeline control 28 and execution (or 
functional units) 30-38, namely, an integer processing unit, a floating-point processing unit, a 
compare unit, a memory unit, and a branch unit. The units 10-38 are coupled as shown in the 
drawing and more particularly detailed below. 
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By way of overview, TPUs 10-20 are virtual processing units, physically implemented 
within processor module 5, that are each bound to and process one (or more) process(es) and/or 
thread(s) (collectively, thread(s)) at any given instant. The TPUs have respective per-thread 
state represented in general purpose registers, predicate registers, control registers. The TPUs 
5 share hardware, such as launch and pipeline control, which launches up to five instructions 
from any combination of threads each cycle. As shown in the drawing, the TPUs additionally 
share execution units 30-38, which independently execute launched instructions without the 
need to know what thread they are from. 

10 By way of further overview, illustrated L2 cache 26 is shared by all of the thread pro- 

cessing units 10-20 and stores instructions and data on storage both internal (local) and exter- 
nal to the chip on which the module 5 is embodied. Illustrated LI instruction and data caches 
22, 24, too, are shared by the TPUs 1 0-20 and are based on storage local to the aforementioned 
chip. (Of course, it will be appreciated that, in other embodiments, the level 1 and level2 caches 

15 may be configured differently — e.g., entirely local to the module 5, entirely external, or other- 
wise). 

The design of module 5 is scalable. Two or more modules 5 may be "ganged" in an 
SoC or other configuration, thereby, increasing the number of active threads and overall pro- 

20 cessing power. Because of the threading model used by the module 5 and described herein, the 
resultant increase in TPUs is software transparent. Though the illustrated module 5 has six 
TPUs 10-20, other embodiments may have a greater number of TPUs (as well, of course, as a 
lesser number). Additional functional units, moreover, may be provided, for example, boosting 
the number of instructions launched per cycle from five to 10-15, or higher. As evident in the 

25 discussion below of LI and L2 cache construction, these too may be scaled. 

Illustrated module 5 utilizes Linux as an application software environment. In conjunc- 
tion with multi-threading, this enables real-time and non-real-time applications to run on one 
platform. It also permits leveraging of open source software and applications to increase prod- 
30 uct functionality. Moreover, it enables execution of applications from a variety of providers. 

MUL TI'ThREADING 

As noted above, TPUs 10-20 are virtual processing units, physically implemented 
35 within a single processor module 5, that are each bound to and process one (or more) thread(s) 
at any given instant. The threads can embody a wide range applications. Examples useful in 
digital LCD-TVs, for example, include MPEG2 signal demultiplexing, MPEG2 video decod- 
ing, MPEG audio decoding, digital-TV user interface operation, operating system execution 
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(e.g,. Linux). Of course, these and/or other applications may be useful in digital LCD TVs and 
the range of other devices and systems in which the module 5 may be embodied. 

The threads executed by the TPUs are independent but can communicate through 
5 memory and events. During each cycle of processor module 5, instructions are launched from 
as many active-executing threads as necessary to utilize the execution or functional units 30— 
38. In the illustrated embodiment, a round robin protocol is imposed in this regard to assure 
"fairness" to the respective threads (though, in other embodiments, priority or other protocols 
can be used instead or in addition). Although one or more system threads may be executing on 
10 the TPUs (e.g., to launch application, facilitate thread activation, and so forth), no operating 
system intervention is required to execute active threads. 

The underlying rationales for supporting multiple active threads (virtual processors) per 
processor are: 

15 

Functional capability 

Multiple active threads per processor enables a single multi-threaded processor to 
replace multiple application, media, signal processing and network processors. It also enables 
20 multiple threads corresponding to application, image, signal processing and networking to 
operate and interoperate concurrently with low latency and high performance. Context switch- 
ing and interfacing overhead is minimized. Even within a single image processing application, 
like MP4 decode, threads can easily operate simultaneously in a pipelined manner to for exam- 
ple prepare data for frame n+1 while frame n is being composed. 

25 

Performance 

Multiple active threads per processor increases the performance of the individual pro- 
cessor by better utilizing functional units and tolerating memory and other event latency. It is 

30 not unusual to gain a 2x performance increase for supporting up to four simultaneously execut- 
ing threads. Power consumption and die size increases are negligible so that performance per 
unit power and price performance are improved. Multiple active threads per processor also 
lowers the performance degradation due to branches and cache misses by having another 
thread execute during these events. Additionally, it eliminates most context switch overhead 

35 and lowers latency for real-time activities. Moreover, it supports a general, high performance 
event model. 
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Implementation 

Multiple active threads per processor leads to simplification of pipeline and overall 
design. There is no need for a complex branch predication, since another thread can run. It 
5 leads to lower cost of single processor chips vs. multiple processor chips, and to lower cost 
when other complexities are eliminated. Further, it improves performance per unit power. 

Figure 2 contrasts thread processing by a conventional superscalar processor with that 
of the illustrated processor module 5. Referring to Figure 2A, in a superscalar processor, 

10 instructions from a single executing thread (indicated by diagonal stippling) are dynamically 
scheduled to execute on available execution units based on the actual parallelism and depen- 
dencies within the code being executed . This means that on the average most execution units 
are not able to be utilized during each cycle. As the number of execution units increases the 
percentage utilization typically goes down. Also execution units are idle during memory 

15 system and branch prediction misses/waits. 

In contrast, referring to Figure 2B, in the module 5, instructions from multiple threads 
(indicated by different respective stippling patterns) execute simultaneously. Each cycle, the 
module 5 schedules instructions from multiple threads to optimally utilize available execution 
20 unit resources. Thus the execution unit utilization and total performance is higher, while at the 
same time transparent to software. 

Events and Threads 

25 In the illustrated embodiment, events include hardware (or device) events, such as 

interrupts; software events, which are equivalent to device events but are initiated by software 
instructions and memory events, such as completion of cache misses or resolution of memory 
producer-consumer (full-empty) transitions. Hardware interrupts are translated into device 
events which are typically handled by an idle thread (e.g., a targeted thread or a thread in a 

30 targeted group). Software events can be used, for example, to allow one thread to directly 
wake another thread. 

Each event binds to an active thread. If a specific thread binding doesn't exist, it binds 
to the default system thread which, in the illustrated embodiment, is always active. That thread 
35 then processes the event as appropriate including scheduling a new thread on a virtual proces- 
sor. If the specific thread binding does exist, upon delivery of a hardware or software event (as 
discussed below in connection with the event delivery mechanism), the targeted thread is tran- 
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sitioned from idle to executing. If the targeted thread is already active and executing, the event 
is directed to default system thread for handling. 



In the illustrated embodiment, threads can become non-executing (block) due to: 
5 Memory system stall (short term blockage), including cache miss and waiting on synchroniza- 
tion; Branch miss-prediction (very short term blockage); Explicitly waiting for an event (either 
software or hardware generated); and System thread explicitly blocking application thread. 

In preferred embodiments of the invention, events operate across physical processors 
10 modules 5 and networks providing the basis for efficient dynamic distributed execution envi- 
ronment. Thus, for example, a module 5 executing in an digital LCD-TV or other device or 
system can execute threads and utilize memory dynamically migrated over a network (wireless, 
wired or otherwise) or other medium from a server or other (remote) device. The thread and 
memory-based events, for example, assure that a thread can execute transparently on any 
15 module 5 operating in accord with the principles hereof. This enables, for example, mobile 
devices to leverage the power of other networked devices. It also permits transparent execu- 
tion of peer-to-peer and multi-threaded applications on remote networked devices. Benefits 
include increased performance, increased functionality and lower power consumption 

20 Threads run at two privilege levels. System and Application. System threads can access 

all state of its thread and all other threads within the processor. An application thread can only 
access non-privileged state corresponding to itself. By default thread 0 runs at system privi- 
lege. Other threads can be configured for system privilege when they are created by a system 
privilege thread. 

25 

Referring to Figure 3, in the illustrated embodiment, thread states are: 
Idle (or Non-active) 



30 Thread context is loaded into a TPU and thread is not executing instructions. An Idle 

thread transitions to Executing, e.g., when a hardware or software event occurs. 



Waiting for Active. Waiting'^ 

35 Thread context is loaded into a TPU, but is currently not executing instructions. A 

Waiting thread transitions to Executing when an event it is waiting for occurs, e.g., a 
cache operation is completed that would allow the memory instruction to proceed. 
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Executing (or Active, Executing'^ 

5 Thread context is loaded into a TPU and is currently executing instructions. A thread 

transitions to Waiting, e.g., when a memory instruction must wait for cache to complete 
an operation, e.g. a cache miss or an Empty/Fill (producer-consumer memory) instruc- 
tion cannot be completed. A thread transitions to idle when a event instruction is exe- 
cuted 

10 

A thread enable bit (or flag or other indicator) associated with each TPU disables thread 
execution without disturbing any thread state for software loading and unloading of a thread 
onto a TPU. 

15 The processor module 5 load balances across active threads based on the availability of 

instructions to execute. The module also attempts to keep the instruction queues for each thread 
uniformly full. Thus, the threads that stay active the most will execute the most instructions. 

Events 

20 

Figure 4 shows an event delivery mechanism in a system according to the one practice 
of the invention. When an event is signaled to a thread, the thread suspends execution (if cur- 
rently in the Executing state) and recognizes the event by executing the default event handler, 
e.g., at virtual address 0x0. 

25 

In the illustrated embodiment, there are five different event types that can be signaled 
to a specific thread: 

30 



35 
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Event Description 

Thread wait The timeout value from a wait instruction executed 

timeout by thread^^ has expired 

Thread Executing instruction has signaled exception, 
exception 

HW Event Event (like interrupt) generated by hardware device. 

SW Event Event (like sw interrupt) signaled by sw event 
instruction 



Memory All pending memory operations for a thready have 

Event completed. 



Thread Delivery 

thread 

n 

thread 

n 

thready as determined by 
event to thread lookup 

instruction specifies thread. 
If that thread is not Active, 
Waiting or Idle delivered 
to default system thread 
thread 



Illustrated Event Queue 40 stages events presented by hardware devices and software- 
15 based event instructions (e.g., software "interrupts") in the form of tuples comprising virtual 
thread number (VTN) and event number: 



6:^ 


^5 


16 


15 4 


:^ 2 


1 


0 




threadnum 


eventnum 




how 


priv 



25 



30 



Bit 


Field 


Description 


0 


priv 


Privilege that the event will be signaled at: 

0. System privilege 

1. Application privilege 


1 


how 


Specifies how the event is signaled if the thread is 
not in idle state. If the thread is in idle state, this 
field is ignored and the event is directly signalled 

0. Wait for thread in idle state. All events after 
this event in the queue wait also. 

1 . Trap thread immediately 


15:4 


eventnum 


Specifies the logical number for this event. The 
value of this field is captured in detail field of the 
system exception status or application exception 

status register. 


31:16 


threadnum 


Specifies the logical thread number that this event is 
signaled to. 



Of course, it will be appreciated that the events presented by the hardware devices and 
software instructions may be presented in other forms and/or containing other information. 
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The event tuples are, in turn, passed in the order received to the event-to-thread lookup 
table (also referred to as the event table or thread lookup table) 42, which determines which 
TPU is currently handling each indicated thread. The events are then presented, in the form of 
"TPU events" comprised of event numbers, to the TPUs (and, thereby, their respective threads) 
5 via the event-to-thread delivery mechanism 44. If no thread is yet instantiated to handle a par- 
ticular event, the corresponding event is passed to a default system thread active on one of the 
TPUs. 

The event queue 40 can be implemented in hardware, software and/or a combination 
10 thereof. In the embedded, system-on-a-chip (SoC) implementation represented by module 5, 
the queue is implemented as a series of gates and dedicated buffers providing the requisite 
queuing function. In alternate embodiments, it is implemented in software (or hardware) 
linked lists, arrays, or so forth. 

1 5 The table 42 establishes a mapping between an event number (e.g., hardware interrupt) 

presented by a hardware device or event instruction and the preferred thread to signal the event 
to. The possible cases are: 

No entry for event number: signal to default system thread. 

20 

Present to thread: signal to specific thread number if thread is in Executing, Active or 
Idle, otherwise signal to specified system thread 

The table 42 may be a single storage area, dedicated or otherwise, that maintains an 
25 updated mapping of events to threads. The table may also constitute multiple storage areas, 
distributed or otherwise. Regardless, the table 42 may be implemented in hardware, software 
and/or a combination thereof. In the embedded, SoC implementation represented by module 5, 
the table is implemented by gates that perform "hardware" lookups on dedicated storage 
area(s) that maintains an updated mapping of events to threads. That table is software-acces- 
30 sible, as well — for example, by system-level privilege threads which update the mappings as 
threads are newly loaded into the TPUs 10-20 and/or deactivated and unloaded from them. In 
turn embodiments, the table 42 is implemented by a software-based lookup of the storage area 
that maintains the mapping. 

35 The event-to-thread delivery mechanism 44, too, may be implemented in hardware, 

software and/or a combination thereof. In the embedded, SoC implementation represented by 
module 5, the mechanism 44 is implemented by gates (and latches) that route the signaled 
events to TPU queues which, themselves, are implemented as a series of gates and dedicated 

16 (DelailecDescription) 



Express Mail Label: US EV 324 849 3 78 US 



buffers 46-48 for queuing be delivered events. As above, in alternate embodiments, the mech- 
anism 44 is implemented in software (or other hardware structures) providing the requisite 
functionality and, likewise, the queues 46-48 are implemented in software (or hardware) 
linked lists, arrays, or so forth. 

An outline of a procedure for processing hardware and software events (i.e., software- 
initiated signalling events or "software interrupts") in the illustrated embodiment is as fol- 
lows: 



10 1 . Event is signalled to the TPU which is currently executing active thread. 

2. That TPU suspends execution of active thread. The Exception Status, Exception 
IP and Exception MemAddress control registers are set to indicate information 
corresponding to the event based on the type of event. All - Thread State is 
15 valid. 



3. The TPU initiates execution at system privilege of the default event handler at 
virtual address 0x0 with event signaling disabled for the corresponding thread 
unit. GP registers 0—3 contain and predicate registers 0-1 are utilized as scratch 

20 registers by the event handlers and are system privilege. By convention GP[0] 

is the event processing stack pointer. 

4. The event handler saves enough state so that it can make itself re-entrant and 
re-enable event signaling for the corresponding thread execution unit. 

25 

5. Event handler then processes the event, which could just be posting the event to 
a S W based queue or taking some other action. 

6. The event handler then restores state and returns to execution of the original 
30 thread. 



Memory-related events are handled only somewhat differently. The Pending (Memory) 
Event Table (PET) 50 holds entries for memory operations (from memory reference instruc- 
tions) which transition a tread from executing to waiting. The table 50, which may be imple- 
35 mented like the event-to-thread lookup table 42, holds the address of the pending memory 
operation, state information and thread ID which initiated the reference. When a memory 
operation is completed corresponding to an entry in the PET and no other pending operations 
are in the PET for that thread, an PET event is signaled to the corresponding thread. 
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An outline of memory event processing according to the illustrated embodiment is as 
follows: 



1 . Event is signal to unit which is currently executing active thread 

2. If the thread is in active-wait state and the event is a Memory Event the thread 
transitions to active-executing and continues execution at the current IP. 
Otherwise the event is ignored. 



10 As further shown in the drawing, in the illustrated embodiment, thread wait timeouts 

and thread exceptions are signalled directly to the threads and are not passed through the event- 
to-thread delivery mechanism 44. 



Traps 

15 

The goal of multi-threading and events is such that normal program execution of a 
thread is not disturbed. The events and interrupts which occur get handled by the appropriate 
thread that was waiting for the event. There are cases where this is not possible and normal 
processing must be interrupted. SEP supports trap mechanism for this purpose. A list of 
20 actions based on event types follows, with a full list of the traps enumerated in the System 
Exception Status Register. 



25 



30 



35 
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15 



Event Type 


Thread State 


Privilege Level 


Action 


Application event 


Idle 


Application or 
System 


Recognize event by 
transitioning to 
execute state, appli- 
cation priv 


System event 


Idle 


Application or 
System 


System trap to 
recognize event, 
transition to execute 
state 


Application event 
(wait for idle) 


Waiting or executing 


Application or 
System 


Event stays queued 
until idle 


Application event 
(trap if not idle) 


Waiting or executing 


Application or 
System 


Application trap to 
recognize event 


System event 


Waiting or executing 


Application 


System trap to 
recognize event 


System event (wait 
for idle) 


Waiting or executing 


System 


Event stays queued 
until idle 


System event (trap if 
noi luie ) 


Waiting or executing 


System 


System trap to 
recognize event 


ApplicationTrap 


Any 


Application 


Application trap 


Application Trap 


Any 


System 


System trap 


System Trap 


Any 


Application 


System trap, system 
privilege level 


System Trap 


Any 


System 


System trap 



Illustrated processor module 5 takes the following actions when a trap occurs: 

1. The IP (Instruction Pointer) specifying the next instruction to be executed is 
loaded in the Exception IP register. 

2. The Privilege Level is stored into bitO of Exception IP register. 

3. The Exception type is loaded into Exception State register 

4. If the exception is related to a memory unit instruction, the memory address 
corresponding to exception is loaded into Exception Memory Address register. 

5. Current privilege level is set to system. 
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6. IP (Instruction Pointer) is cleared (zero). 

7. Execution begins at IP 0. 

5 Virtual Memory and Memory System 

The illustrated processor module 5 utilizes a virtual memory and memory system archi- 
tecture having a 64-bit Virtual Address (VA) space, a 64-bit System Address (SA) (having dif- 
ferent characteristics than a standard physical address), and a segment model of virtual address 
10 to system address translation with a sparsely filled VA or SA. 

All memory accessed by the TPUs 10-20 is effectively managed as cache, even though 
off-chip memory may utilize DDR DRAM or other forms of dynamic memory. Referring 
back to Figure 1, in the illustrated embodiment, the memory system consists of two logical 

15 levels. The level 1 cache, which is divided into separate data and instruction caches, 24, 22, 
respectively, for optimal latency and bandwidth. Illustrated level2 cache 26 consists of an on- 
chip portion and off-chip portion referred to as level2 extended. As a whole, the level2 cache 
is the memory system for the individual SEP processor(s) 5 and contributes to a distributed "all 
cache" memory system in implementations where multiple SEP processors 5 are used. Of 

20 course, it will be appreciated that those multiple processors would not have to be physically 
sharing the same memory system, chips or buses and could, for example, be connected over a 
network or otherwise. 

Figure 5 illustrates VA to SA translation used in the illustrated system, which transla- 
25 tion is handled on a segment basis, where (in the illustrated embodiment) those segments can 
be of variable size, e.g., 2^'*-2'** bytes. The SAs are cached in the memory system. So an SA 
that is present in the memory system has an entry in one of the levels of cache 22/24, 26. An 
SA that is not present in any cache (and the memory system) is effectively not present in the 
memory system. Thus, the memory system is filled sparsely at the page (and subpage) granu- 
30 larity in a way that is natural to software and OS, without the overhead of page tables on the 
processor. 

In addition to the foregoing the virtual memory and memory system architecture of the 
illustrated embodiment has the following additional features: Direct support for distributed 
35 shared: Memory (DSM), Files (DSF), Objects (DSO), Peer to Peer (DSP2P); Scalable cache 
and memory system architecture; Segments that can be shared between threads; Fast level 1 
cache, since lookup is in parallel with tag access, with no complete virtual-to-physical address 
translation or complexity of virtual cache. 



20 
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Virtual Memory Overview 

A virtual address in the illustrated system is the 64-bit address constructed by memory 
reference and branch instructions. The virtual address is translated on a per segment basis to a 
5 system address which is used to access all system memory and lO devices. Each segment can 
vary in size from 2^^ to 2"*^ bytes. More specifically, referring to Figure 5, the virtual address 
50 is used to match an entry in a segment table 52 in the manner shown in the drawing. The 
matched entry 54 specifies the corresponding system address, when taken in combination with 
the components of the virtual address identified in drawing. In addition, the matched entry 54 
10 specifies the corresponding segment size and privilege. That system address, in turn, maps in 
to the system memory — ^which in the illustrated embodiment comprises 2^^ bytes sparsely 
filled. The illustrated embodiment permits address translation to be disabled by threads with 
system privilege, in which case the segment table is bypassed and all addresses are truncated 
to the low 32 bits. 

15 

Illustrated segment table 52 comprises 16—32 entries per thread (TPU). The table may 
be implemented in hardware, software and/or a combination thereof. In the embedded, SoC 
implementation represented by module 5, the table is implemented in hardware, with separated 
entries in memory being provided for each thread (e.g., a separate table per thread). A segment 
20 can be shared among two or more threads by setting up a separate entry for each thread that 
points to the same system address. Other hardware or software structures may be used instead, 
or in addition, for this purpose. 

Cache Memory System Overview 

25 

As noted above, the Level 1 cache is organized as separate levell instruction cache 22 
and levell data cache 24 to maximize instruction and data bandwidth. 

Referring to Figure 6, the on-chip L2 cache 26a consists of the tag and data portions. In 
30 the illustrated embodiment, it is .5—1 Mbytes in size, with 128 blocks, 16-way associative. 
Each block stores 128 bytes data or 16 extended L2 tags, with 64 kbytes are provided to store 
the extended L2 tags. A tag-mode bit within the tag indicates that the data portion consists of 
1 6 tags for Extended L2 Cache. 

35 The extended L2 cache 26b is, as noted above, DDR DRAM-based, though other 

memory types can be employed. In the illustrated embodiment, it is up to 1 gbyte in size, 256- 
way associative, with 16k byte pages and 128 byte subpages. For a configuration of .5 mbyte 
L2 cache 26a and 1 gbyte L2 extended cache 26b, only 12% of on-chip L2 cache is required to 
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fully describe L2 extended. For larger on-chip L2 or smaller L2 extended sizes the percentage 
is lower. The aggregation of L2 caches (on-chip and extended) make up the distributed SEP 
memory system. 

5 In the illustrated embodiment, both the LI instruction cache 22 and the LI data cache 

24 are 8-way associative with 32k bytes and 128 byte blocks. As shown in the drawing, both 
level 1 caches are proper subsets of level2 cache. The level2 cache consists of an on-chip and 
off chip extended L2 Cache. 

10 Figure 7 depicts the L2 cache 26a and the logic used in the illustrated embodiment to 

perform a tag lookup in L2 cache 26a to identify a data block 70 matching an L2 cache address 
78. In the illustrated embodiment, that logic includes sixteen Cache Tag Array Groups 72a- 
72p, corresponding Tag Compare elements 74a-74p and corresponding Data Array Groups 
76a-76p. These are coupled as indicated to match an L2 cache address 78 against the Group 

15 Tag Arrays 72a-72p, as shown, and to select the data block 70 identified by the indicated Data 
Array Group 76a— 76p, again, as shown. 

The Cache Tag Array Groups 72a-72p, Tag Compare elements 74a— 74p, corresponding 
Data Array Groups 76a-76p may be implemented in hardware, software and/or a combination 

20 thereof. In the embedded, SoC implementation represented by module 5, these are imple- 
mented in as shown in Figure 19, which shows the Cache Tag Array Groups 72a-72p embod- 
ied in 32 X 256 single port memory cells and the Data Array Groups 76a-76p embodied in 128 
X 256 single port memory cells, all coupled with current state control logic 190 as shown. That 
element is, in turn, coupled to state machine 192 which facilitates operation of the L2 cache 

25 unit 26a in a manner consistent herewith, as well as with a request queue 192 which buffers 
requests from the LI instruction and data caches 22, 24, as shown. 

The logic element 190 is further coupled with DDR DRAM control interface 26c which 
provides an interface to the off-chip portion 26b of the L2 cache. It is likewise coupled to 

30 AMBA interface 26d providing an interface to AMBA-compatible components, such as liquid 
crystal displays (LCDs), audio out interfaces, video in interfaces, video out interfaces, network 
interfaces (wireless, wired or otherwise), storage device interfaces, peripheral interfaces (e.g., 
USB, USB2), bus interfaces (PCI, ATA), to name but a few. The DDR DRAM interface 26c 
and AMBA interface 26d are likewise coupled to an interface 1 96 to the L 1 instruction and data 

35 caches by way of L2 data cache bus 198, as shown. 

Figure 8 likewise depicts the logic used in the illustrated embodiment to perform a tag 
lookup in L2 extended cache 26b and to identify a data block 80 matching the designated 
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address 78. In the illustrated embodiment, that logic includes Data Array Groups 82a-82p, 
corresponding Tag Compare elements 84a-84p, and Tag Latch 86. These are coupled as indi- 
cated to match an L2 cache address 78 against the Data Array Groups 72a-72p, as shown, and 
to select a tag from one of those groups that matches the corresponding portion of the address 
5 78, again, as shown. The physical page number from the matching tag is combined with the 
index portion of the address 78, as shown, to identify data block 80 in the off chip memory 
26b. 

The Data Array Groups 82a-82p and Tag Compare elements 84a-84p may be imple- 
10 mented in hardware, software and/or a combination thereof. In the embedded, SoC implemen- 
tation represented by module 5, these are implemented in gates and dedicated memory 
providing the requisite lookup and tag comparison functions. Other hardware or software 
structures may be used instead, or in addition, for this purpose. 

1 5 The following is a pseudo-code illustrates L2 and L2E cache operation in the illustrated 

embodiment: 

L2 tag lookup, if hit respond back with data to LI cache 
else L2E tag lookup, if hit 
20 allocate tag in L2; 

access L2E data, store in corresponding L2 entry; 
respond back with data to LI cache; 
else extended L2E tag lookup 
allocate L2E tag; 
25 allocate tag in L2; 

access L2E data, store in corresponding L2 entry; 
respond back with data to LI cache; 

Thread Processing Unit State 

30 

Referring to Figure 9, the illustrated embodiment has six TPUs supporting up to six 
active threads. Each TPU 10-20 includes general-purpose registers, predicate registers, and 
control registers, as shown in Figure 9. Threads at both system and application privilege levels 
contain identical state, although some thread state information is only visible when at system 
35 privilege level — as indicated by the key and respective stippling patterns. In addition to regis- 
ters, each TPU additionally includes a pending memory event table, an event queue and an 
event-to-thread lookup table, none of which are shown in Figure 9. 
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Depending on the embodiment, there can be from 48 (or fewer) to 128 (or greater) gen- 
eral-purpose registers, with the illustrated embodiment having 128; 24 (or fewer) to 64 (or 
greater) predicate registers, with the illustrated embodiment having 32; six (or fewer) to 256 (or 
greater) active threads, with the illustrated embodiment having 8; a pending memory event 
5 table of 16 (or fewer) to 512 (or greater) entries, with the illustrated embodiment having 16; a 
number of pending memory events per thread, preferably of at least two (though potentially 
less); an event queue of 256 (or greater, or fewer); and an event-to-thread lookup table of 16 (or 
fewer) to 256 (or greater) entries, with the illustrated embodiment having 32. 

10 General Purpose Registers 

In the illustrated embodiment, each thread has up to 128 general purpose registers 
depending on the implementation. General Purpose registers 3-0 (GP[3:0]) are visible at 
system privilege level and can be utilized for event stack pointer and working registers during 
15 early stages of event processing. 

Predication registers 

The predicate registers are part of the general purpose SEP predication mechanism. 
20 The execution of each instruction is conditional based on the value of the reference predicate 
register. 

The SEP provides up to 64 one-bit predicate registers as part of thread state. Each 
predicate register holds what is called a predicate, which is set to 1 (true) or reset to 0 (false) 
25 based on the result of executing a compare instruction. Predicate registers 3-1 (PR[3:1]) are 
visible at system privilege level and can be utih'zed for working predicates during early stages 
of event processing. Predicate register 0 is read only and always reads as 1, true. It is by 
instructions to make their execution unconditional. 

30 Control Registers 



Thread State Register 



35 



63 20 


19 


18 


17 


16 


15 8 


6 


5 4 


3 


2 


1 


0 




daddr 


iaddr 


align 


endian 


mod 




Thread 
state 


priv 


tenable 


atrapen 


strapen 



24 
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Bit 


Field 


Description 


Privilege 


Per 


Design 
Usage 




0 


strapen 


System trap enable. On reset cleared. Signal- 


systemrw 


Thread 


Branch 








ling of system trap resets this bit and atrapen 
until it is set again by software when it is once 








5 






again re-entrant. 

0- System traps disabled 

1 - Events enabled 








10 


1 


atrapen 


Application trap enable. On reset cleared. 
Signalling of application trap resets this bit 
until it is set again by software when it is once 


app_rw 


Thread 








again re-entrant. Application trap is cause by 
an event that is marked as application level 
when the privilege level is also application 
level 

0- Events disabled (events are disabled 








15 






on event delivery to thread) 
1 - Events enabled 










2 


tenable 


Thread Enable. On reset set for thread 0, 
cleared for all other threads 

0- Thread operation is disabled. System 
thread can load or store thread state. 

1- Thread operation is enabled. 


System_rw 


Thread 


Branch 


20 


3 


priv 


Privilege level. On reset cleared. 

0- System privilege 

1 - Application privilege 


System_rw 
App_r 


Thread 


Branch 




5:4 


state 


Thread State. On reset set to "executing" for 
threadO, set to "idle" for all other threads. 
0- Idle 


System_rw 


Thread 


Branch 


25 






1 - reserved 

2- Waiting 

3- Executing 










15:8 


mod[7:0] 


GP Registers Modified. Cleared on reset, 
bit 8 registers 0-15 


App_rw 


Thread 


Pipe 


30 






bit 9 registers 16-31 
bit 10 registers 32-47 
bit 1 1 registers 48-63 
bit 12 registers 63-79 
bit 13 registers 80-95 
bit 14 registers 96-111 
bit 15 registers 112-127 








35 


16 


endian 


Endian Mode- On reset cleared. 


Systemrw 


Proc 


Mem 






0- little endian 

1- big endian 


App_r 
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5 



10 



17 


align 


Alignment check- When clear, unaligned 
memory references are allowed. When set, all 
un-aligned memory references result in 
unaligned data reference fault. On reset 
cleared. 


Systemrw 
App_r 


Proc 


Mem 


18 


iaddr 


Instruction address translation enable. On 
reset cleared. 

0- disabled 

1- enabled 


System_rw 
App_r 


Proc 


Branch 


19 


daddr 


Data address translation enable. On reset 
cleared. 

0- disabled 

1- enabled 


System_rw 
App_r 


Proc 


Mem 



ID Register 



63 32 


39 32 


31 16 


15 8 


7 0 






thread_id 


id 


type 



Bit 


Field 


Description 


Privilege 


Per 


7:0 


type 


Processor type and revision[7:0] 


read only 


Proc 


15:8 


id 


Processor ID[7:0]- Virtual processor number 


read only 


Thread 


31:16 


thread_id 


Thread ID[ 15:0] 


System_rw 
App_ro 


Thread 



Instruction Pointer Register 



63 




4 


3 


1 


0 


Doubleword 


mask 


0 



30 

Specifies the 64-bit virtual address of the next instruction to be executed. 



35 
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Bit 


Field 


Description 


Privilege 


Per 


63:4 


Doubieword 


Address of instruction doubieword 


app 


thread 


3:2 


rnd.slc 


Indicates which in^triictirtn^ within inQtniPtJnn rlr\ii. 

bleword remain to be executed. 

• Bitl- first instruction doubieword bit[40:00] 

• Bit2- second instruction doubieword bit[81 : 
41] 

• B it3 - third instruction doubieword, bit[ 1 22 : 

82] 


app 


thr^siH 
till vau 


0 




Always read as zero 


app 


thread 



10 

System Exception Status Register 





63 


4 


15 


4 


3 0 


15 




detail 


etype 



20 



25 



Bit 


Field 


Description 


Privilege 


Per 


3:0 


etype 


Exception Type 


read only 


Thread 






0. 


none 










1. 


event 










2. 


timer event 










3. 


SystemCall 










4. 


Single Step 










5. 


Protection Fault 










6. 


Protection Fault, system call 










7. 


Memory reference Fault 










8. 


SW event 










9. 


HW fault 










10. 


others 






15:4 


detail 


Fault details- Valid for the following exception types: 

• Memory reference fault details (type 5) 

1 . None 

2. waiting for fill 

3. waiting for empty 

4. waiting for completion of cache miss 

5. memory reference error 

• event (type 1 ) - Specifies the 1 2 bit event number 







35 
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Application Exception Status Register 





63 


4 


15 


4 


3 0 


5 




detail 


etype 





Bit 


Field 


Description 


Privilege 


Per 




3:0 


etype 


Exception Type 
0. none 


read only 


Thread 


10 






1 . event 










2. timer event 

3. SystemCall 

4. Single Step 

5. Protection Fault 

6. Protection Fault, system call 






15 






7. Memory reference Fault 

8. SW event 

9. HW fault 

10. Others 








15:4 


detail 


Protection Fault details- Valid for the following exception 
types: 

• event (type 1) - Specifies the 12 bit event number 







20 

System Exception IP 





63 




4 


3 


1 


0 


25 


Doubleword 


mask 


priv 



Address of instruction corresponding to signaled exception to system privilege. Bit[0] 
is the privilege level at the time of the exception. ^ 

30 
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Bit 


Field 


Description 


Privilege 


Per 


63:4 


Doubleword 


Address of instruction doubleword which signaled 
exception 


system 


thread 






InHipJiff*^ \A/hifh inctn ir*tionc within inctriif*t"irtn 

doubleword remain to be executed. 

• Bit! - first instruction doubleword bit[40:00] 

• Bit2- second instruction doubleword bit[8 1 : 
41] 

• Bit3- third instruction doubleword, bit[122: 
82] 


C\/Cl'^tVI 

oyolCIIl 


th Q /A 

Liircctu 


0 


priv 


Privilege level of thread at time of exception 


system 


thread 



Address of instruction corresponding to signaled exception. Bit[0] is the privilege level 
at the time of the exception. 



A pplication Exception IP 



63 




4 


3 1 


0 


Doubleword 


mask 





20 

Address of instruction corresponding to signaled exception to application privilege. 





Bit 


Field 


Description 


Privilege 


Per 




63:4 


Doubleword 


Address of instruction doubleword which signaled 


system 


thread 


25 






exception 






3:1 


mask 


Indicates which instructions within instruction 
doubleword remain to be executed. 

• Bitl - first instruction doubleword bit[40:00] 

• Bit2- second instruction doubleword bit[81 : 
41] 

• Bit3- third instruction doubleword, bit[122: 


system 


thread 


30 






82] 







Address of instruction corresponding to signaled exception. Bit[0] is the privilege level 
at the time of the exception. 

35 
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Exception Mem Address 
63 



Address 



Address of memory reference that signaled exception. Valid only for memory faults. 
Holds the address of the pending memory operation when the Exception Status register indi- 
cates memory reference fault, waiting for fill or waiting for empty. 

Instruction Seg Table Pointer nSTP\ Data Seg Table Pointer (DSTP> 



63 


32 


31 


6 


5 1 


0 




reserved 


ste number 


field 



Utilized by ISTE and ISTE registers to specify the ste and field that is read or written. 



20 



Bit 


Field 


Description 


Privilege 


Per 


0 


field 


Specifies the low (0) or high (1) portion of Segment 
Table Entry 


system 


thread 


5:1 


ste number 


Specifies the STE number that is read into STE Data 
Register. 


system 


thread 



Instruction Segment Table Entry flSTE^. Data Segment Table Entry 
fDSTE) 



_63 0^ 

data 

30 

When read the STE specified by ISTE register is placed in the destination general reg- 
ister. When written, the STE specified by ISTE or DSTE is written from the general purpose 
source register. The format of segment table entry is specified in Chapter 6- section titled 
Translation Table organization and entry description. 

35 
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Instruction or Data Level 1 Cache Tag Pointer HCTP. DCTP'> 



63 32 


15 14 


13 7 


6 2 


1 0 




reserved 


index 


bank 





Specifies the Instruction Cache Tag entry that is read or written by the ICTE or 

DCTE. 



Bit 


Field 


Description 


Privilege 


Per 


6:2 


bank 


Specifies the bank that is read from Level 1 Cache 
Tag Entry. The first implementation has valid banks 
OxO-f. 


system 


thread 


13:7 


index 


Specifies the index address within a bank that is read 
from Level! Cache Tag Entry 


System 


thread 



15 

Instruction or Data Level 1 Cache Tag Entry flCTE. DCTE^ 



63 



20 



data 



When read the Cache Tag specified by ICTP or DCTP register is placed in the destina- 
tion general register. When w^ritten, the Cache Tag specified by ICTP or DCTP is written from 
the general purpose source register. The format of cache tag entry is specified in Chapter 6- 
25 section titled Translation Table organization and entry description. 



Event Queue Control Register 



30 



63 32 


31 19 


18 


17 2 


1 0 




address 


offset 


event 


reg_op 



The Event Queue Control Register (EQCR) enables normal and diagnostic access to the 
event queue. The sequence for using the register is a register write followed by a register read. 
35 The contents of the reg_op field specifies the operation for the write and the next read. The 
actual register modification or read is triggered by the write. 



31 
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5 



10 



Bit 


Field 


Description 


Privilege 


Per 


1:0 


reg_op 


Specifies the register operation for that write and the 
next read. Valid for register read. 
0- read 
1 - write 

2- push onto queue 

3- pop from queue 


system 


proc 


17:2 


event 


For writes and push specifies the event number 
written or pushed onto the queue. For read and pop 
operations contains the event number read or popped 
from the queue 


system 


proc 


18 


empty 


Indicates whether the queue was empty prior to the 
current operation. 


system 


proc 


31:19 


address 


Specifies the address for read and write queue opera- 
tions. Address field is don't care for push and pop 
operations. 


system 


proc 



15 

Event-Thread Lookup Table Control 



20 



63 9 


48 41 


40 33 


32 17 


16 1 


0 




address 


thread 


mask 


event 


regop 



The Event to Thread lookup table establishes a mapping between an event number pre- 
sented by a hardware device or event instruction and the preferred thread to signal the event to. 
Each entry in the table specifies an event number with a bit mask and a corresponding thread 
25 that the event is mapped to. 



30 



35 



32 
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5 



10 



Bit 


Field 


Description 


Privilege 


Per 


0 


reg op 


Specifies the register operation for that write and the 
next read. Valid for register read. 

0- read 

1- write 


system 


proc 


16:1 


event[15:0] 


For writes specifies the event number written at the 
specified table address. For read operations contains 
the event number at the specified table address 


system 


proc 


32:17 


mask[15:0] 


Specifies whether the corresponding event bit is 
significant. 

0- significant 

1- don't care 


system 


proc 


40:33 


thread 








48:41 


address 


Specifies the table address for read and write opera- 
tions. Address field is don't care for push and pop 
operations. 


system 


proc 



15 

Timers and Performance Monitor 



20 



In the illustrated embodiment, all timer and performance monitor registers are accessi- 
ble at application privilege. 



Clock 



63 



25 



clock 



30 



Bit 


Field 


Description 


Privilege 


Per 


63:0 


clock 


Number of clock cycles since processor reset 


app 


proc 



35 



33 
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Instructions executed 





63 


32 


31 




0 


5 




count 



10 



Bit 


Field 


Description 


Privilege 


Per 


31:0 


count 


Saturating count of the number of instruction exe- 
cuted. Cleared on read. Value of all 1 's indicates 
that the count has overflowed. 


app 


thread 



Thread execution clock 





63 


32 


31 




0 


5 




active 





Bit 


Field 


Description 


Privilege 


Per 


20 


31:0 


active 


Saturating count of the number of cycles the thread is 
in active-executing state. Cleared on read. Value of 
all 1 's indicates that the count has overflowed. 


app 


thread 



Wait Timeout Counter 



25 



63 


32 


31 


0 




timeout 





Bit 


Field 


Description 


Privilege 


Per 


30 


31:0 


timeout 


Count of the number of cycles remaining until a 
timeout event is signaled to thread. Decrements by 
one, each clock cycle. 


app 


thread 



Virtual Processor and Thread ID 

35 

In the illustrated embodiment, each active thread corresponds to a virtual processor and 
is specified by a 8-bit active thread number (activethread[7:0]). The module 5 supports a 1 6-bit 
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thread ID (threaded[l 5:0]) to enable rapid loading (activation) and unloading (de-activation) of 
threads. Other embodiments may support thread IDs of different sizes. 

Thread-Instruction Fetch Abstraction 

5 

As noted above, the TPUs 10-20 of module 5 share L I instruction cache 22, as well as 
pipeline control hardware that launches up to five instructions each cycle from any combina- 
tion of the threads active in those TPUs. Figure 1 0 is an abstraction of the mechanism employed 
by module 5 to fetch and dispatch those instructions for execution on functional units 30—38. 

10 

As shown in that drawing, during each cycle, instructions are fetched from the LI cache 
22 and placed in instruction queues 10a— 20a associated with each respective TPU 10—20. This 
is referred to as the fetch stage of the cycle. In the illustrated embodiment, three to six instruc- 
tions are fetch for each single thread, with an overall goal of keeping thread queues 10a-20a at 
15 equal levels. In other embodiments, different numbers of instructions may be fetched and/or 
different goals set for relative filling of the queues. Also during the fetch stage, the module 5 
(and, specifically, for example, the event handling mechanisms discussed above) recognize 
events and transition corresponding threads from waiting to executing, 

20 During the dispatch stage — ^which executes in parallel with the fetch and execute/retire 

stages — instructions from each of one or more executing threads are dispatched to the func- 
tional units 30-38 based on a round-robin protocol that takes into account best utilization of 
those resources for that cycle. These instructions can be from any combination of threads. The 
compiler specifies, e.g., utilizing "stop" flags provided in the instruction set, boundaries 

25 between groups of instructions within a thread that can be launched in a single cycle. In other 
embodiments, other protocols may be employed, e.g., ones that prioritize certain threads, ones 
that ignore resource utilization, and so forth. 

During the execute & retire phase — which executes in parallel with the fetch and dis- 
30 patch stages — ^multiple instructions are executed from one or more threads simultaneously. As 
noted above, in the illustrated embodiment, up to five instructions are launched and executed 
each cycle, e.g., by the integer, floating, branch, compare and memory functional units 30-38. 
In other embodiments, greater or fewer instructions can be launched, for example, depending 
on the number and type of functional units and depending on the number of TPUs. 

35 

An instruction is retired after execution if it completes: its result is written and the 
instruction is cleared from the instruction queue. 
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On the other hand, if an instruction blocks, the corresponding thread is transitioned 
from executing to waiting. The blocked instruction and all instructions following it for the cor- 
responding thread are subsequently restarted when the condition that caused the block is 
resolved. Figure 1 1 illustrates a three-pointer queue management mechanism used in the illus- 
5 trated embodiment to facilitate this. 

Referring to that drawing, an instruction queue and a set of three pointers is maintained 
for each TPU 10—20. Here, only a single such queue 1 10 and set of pointers 112-1 16 is shown. 
The queue 110 holds instructions fetched, executing and retired (or invalid) for the associated 

10 TPU — ^and, more particularly, for the thread currently active in that TPU. As instructions are 
fetched, they are inserted at the queue's top, which is designated by the Insert (or Fetch) pointer 
1 12. The next instruction for execution is identified by the Extract (or Issue) pointer 114. The 
Commit pointer 116 identifies the last instruction whose execution has been committed. When 
an instruction is blocked or otherwise aborted, the Commit pointer 1 16 is rolled back to quash 

1 5 instructions between Commit and Extract pointers in the execution pipeline. Conversely, when 
a branch is taken, the entire queue is flushed and the pointers reset. 

Though the queue 110 is shown as circular, it will be appreciated that other configura- 
tions may be utilized as well. The queuing mechanism depicted in Figure 11 can be imple- 

20 mented, for example, as shown in Figure 12. Instructions are stored in dual ported memory 
120 or, alternatively, in a series of registers (not shown). The write address at which each newly 
fetched instruction is stored is supplied by Fetch pointer logic 122 that responds to a Fetch 
command (e.g., issued by the pipeline control) to generate successive addresses for the memory 
1 20. Issued instructions are taken from the other port, here, shown at bottom. The read address 

25 from which each instruction is taken is supplied by Issue/Commit pointer logic 1 24. That logic 
responds to Commit and Issue commands (e.g., issued by the pipeline control) to generate suc- 
cessive addresses and/or to reset, as appropriate. 

Processor Module Implementation 

30 

Figure 13 depicts an SoC implementation of the processor module 5 of Figure 1 includ- 
ing, particularly, logic for implementing the TPUs 10-20. As in Figure 1, the implementation 
of Figure 13 includes LI and L2 caches 22-26, which are constructed and operated as dis- 
cussed above. Likewise, the implementation includes functional units 30-34 comprising an 
35 integer unit, a floating-point unit, and a compare unit, respectively. Additional functional units 
can be provided instead or in addition. Logic for implementing the TPUs 10-20 includes pipe- 
line control 130, branch unit 38, memory unit 36, register file 136 and load-store buffer 138. 
The components shown in Figure 13 are interconnected for control and information transfer as 
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shown, with dashed lines indicating major control, thin solid lines indicating predicate value 
control, thicker solid lines identifying a 64-bit data bus and still thicker lines identifying a 128- 
bit data bus. It will be appreciated that Figure 13 represents one implementation of a processor 
module 5 according to invention and that other implementations may be realized as well. 

5 

Pipeline Control Unit 

In the illustrated embodiment, pipeline control 130 contains the per-thread queues dis- 
cussed above in connection with Figures 11-12. There can be parameterized at 12, 15 or 18 

10 instructions per thread. The control 130 picks up instructions from those queues on a round 
robin basis (though, as also noted, this can be performed on other bases as well). It controls 
the sequence of accesses to the register file 136 (which is the resource which provides source 
and destination registers for the instructions), as well as to the functional units 30-38. The 
pipeline control 130 decodes basic instruction classes from the per-thread queues and dis- 

15 patches instructions to the functional units 30-38. As noted above, multiple instructions from 
one or more threads can be scheduled for execution by those functional units in the same cycle. 
The control 130 is additionally responsible for signaling the branch unit 38 as it empties the 
per-thread construction queues, and for idling the functional units when possible, e.g., on a 
cycle by cycle basis, to decrease our consumption. 

20 

Figure 14 is a block diagram of the pipeline control unit 130. The unit includes control 
logic 140 for the thread class queues, the thread class (or per-thread) queues 142 themselves, 
an instruction dispatch 144, a longword decode unit 146, and functional units queues 148a- 
148e, connected to one another (and to the other components of module 5) as shown in the 

25 drawing. The thread class (per-thread) queues are constructed and operated as discussed above 
in connection with Figures 11-12. The thread class queue control logic 140 controls the input 
side of those queues 142 and, hence, provides the Insert pointer functionality shown in Figures 
11—12 and discussed above. The control logic 140 is also responsible for controlling the input 
side of the unit queues 148a-148e, and for interfacing with the branch unit 38 to control instruc- 

30 tion fetching. In this latter regard, logic 140 is responsible for balancing instruction fetching 
in the manner discussed above (e.g., so as to compensate for those TPUs that are retiring the 
most instructions). 

The instruction dispatch 144 evaluates and determines, each cycle, the schedule of 
35 available instructions in each of the thread class queues. As noted above, in the illustrated 
embodiment the queues are handled on a round robin basis with account taken for queues that 
are retiring instructions more rapidly. The instruction dispatch 144 also controls the output 
side of the thread class queues 142. In this regard, it manages the Extract and Commit pointers 
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10 



discussed above in connection with Figures 11-12, including updating the Commit pointer 
wind instructions have been retired and rolling that pointer back when an instruction is aborted 
(e.g., for thread switch or exception). 

The longword decode unit 146 decodes incoming instruction longwords from the LI 
instruction cache 22. In the illustrated embodiment, each such longword is decoded into the 
instructions. This can be parameterized for decoding one or two longwords, which decode into 
three and six instructions, respectively. The decode unit 146 is also responsible for decoding 
the instruction class of each instruction. 



Unit queues 148a-148e queue actual instructions which are to be executed by the func- 
tional units 30-38. Each queue is organized on a per-thread basis and is kept consistent with 
the class queues. The unit queues are coupled to the thread class queue control 140 and to the 
instruction dispatch 144 for control purposes, as discussed above. Instructions from the queues 
15 148a-148e are transferred to corresponding pipelines 150a-150b en route to the functional 
units themselves 30-38. The instructions are also passed to the register file pipeline 152. 

Figure 15 is a block diagram of an individual unit queue, e.g., 148a. This includes one 
instruction queue 154a— 154e for each TPU. These are coupled to the thread class queue con- 

20 trol 140 (labeled tcqueue ctl) and the instruction dispatch 144 (labelled idispatch) for control 
purposes. These are also coupled to the longword decode unit 146 (labeled Iwdecode) for 
instruction input and to a thread selection unit 1 56, as shown. That unit controls thread selec- 
tion based on control signals provided by instruction dispatch 144, as shown. Output from unit 
156 is routed to the corresponding pipeline 150a-150e, as well as to the register file pipeline 

25 152. 



Referring back to Figure 14, integer unit pipeline 150a and floating-point unit pipeline 
150b decode appropriate instruction fields for their respective functional units. Each pipeline 
also times the commands to that respective functional units. Moreover, each pipeline 150a, 

30 150b applies squashing to the respective pipeline based on branching or aborts. Moreover, 
each applies a powerdown signal to its respective functional unit when it is not used during a 
cycle. Illustrated compare unit pipeline 150c, branch unit pipeline 150d, and memory unit 
pipeline 1 50e, provide like functionality for their respective functional units, compare unit 34, 
branch unit 38 and memory unit 36. Register file pipeline 150 also provide like functionality 

35 with respect to register file 136. 



38 
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Referring, now, back to Figure 13, illustrated branch unit 38 is responsible for instruc- 
tion address generation and address translation, as well as instruction fetching. In addition, it 
maintains state for the thread processing units 10-20. Figure 16 is a block diagram of the 
branch unit 38. It includes control logic 160, thread state stores 162a-162e, thread selector 
5 164, address adder 166, segment translation content addressable memory (CAM) 168, con- 
nected to one another (and to the other components of module 5) as shown in the drawing. 

The control logic drives 160 unit 38 based on a command signal from the pipeline con- 
trol 130. It also takes as input the instruction cache 22 state and the L2 cache 26 acknowledg- 
10 ment, as illustrated. The logic 160 outputs a thread switch to the pipeline control 130, as well 
as commands to the instruction cache 22 and the L2 cache, as illustrated. The thread state 
stores 162a-162e store thread state for each of the respective TPUs 10-20. For each of those 
TPUs, it maintains the general-purpose registers, predicate registers and control registers 
shown in figure 3 and discussed above. 

15 

Address information obtained from the thread state stores is routed to the thread selec- 
tor, as shown, which selects the thread address from which and address computation is to be 
performed based on a control signal (as shown) from the control 160. The address adder 166 
increments the selected address or perfonns a branch address calculation, based on output of 
20 the thread selector 164 and addressing information supplied by the register file (labelled regis- 
ter source), as shown. In addition, the address adder 166 outputs a branch result. The newly 
computed address is routed to the segment translation memory 168, which operates as dis- 
cussed above in connection with Figure 5, which generates a translated instruction cache 
address for use in connection with the next instruction fetch. 

25 

Functional Units 



Turning back to Figure 13, memory unit 36 is responsible for memory referents instruc- 
tion execution, including data cache 24 address generation and address translation. In addition, 
30 unit 36 maintains the pending (memory) event table (PET) 50, discussed above. Figure 17 is 
a block diagram of the memory unit 36. It includes control logic 170, address adder 172, and 
segment translation content addressable memory (CAM) 1 74, connected to one another (and to 
the other components of module 5) at shown in the drawing. 

35 The control logic drives 1 70 unit 36 based on a command signal from the pipeline con- 

trol 130. It also takes as input the data cache 22 state and the L2 cache 26 acknowledgment, as 
illustrated. The logic 170 outputs a thread switch to the pipeline control 130 and branch unit 
38, as well as commands to the data cache 24 and the L2 cache, as illustrated. The address 
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adder 172 increments addressing information provided from the register file 136 or performs a 
requisite address calculation. The newly computed address is routed to the segment translation 
memory 174, which operates as discussed above in connection with Figure 5, which generates 
a translated instruction cache address for use in connection with a data access. Though not 
5 shown in the drawing, the unit 36 also includes the PET, as previously mentioned. 

Figure 18 is a block diagram of a cache unit implementing any of the LI instruction 
cache 22 or L2 data cache 24. The unit includes sixteen 128 x 256 byte single port memory 
cells 1 80a-l 80p serving as data arrays, along with sixteen corresponding 32 x 56 byte dual port 
10 memory cells 182a-182p serving as tag arrays. These are coupled to LI and L2 address and 
data buses as shown. Control logic 184 and 186 are coupled to the memory cells and to LI 
cache control and L2 cache control, also as shown. 

Returning, again, to Figure 13, the register file 136 serves as the resource for all source 
15 and destination registers accessed by the instructions being executed by the functional units 
30-38. The register file is implemented as shown in Figure 20. As shown there, to reduce 
delay and wiring overhead, the unit 136 is decomposed into a separate register file instance per 
functional unit 30—38. In the illustrated embodiment, each instance provides forty-eight 64-bit 
registers for each of the TPUs. Other embodiments may vary, depending on the number of 
20 registers allotted the TPUs, the number of TPUs and the sizes of the registers. 

Each instance 200a-200e has five write ports, as illustrated by the arrows coming into 
the top of each instance, via which each of the functional units 30-38 can simultaneously write 
output data (thereby insuring that the instances retain consistent data). Each provides a varying 
25 number of read ports, as illustrated by the arrows eminating from the bottom of each instance, 
via which their respective functional units obtain data. Thus, the instances associated with the 
integer unit 30, the floating point unit 32 and the memory unit all have three read ports, the 
instance associated with the compare unit 34 has two read ports, and the instance associated 
with the branch unit 38 has one port, as illustrated. 

30 

The register file instances 200-200e can be optimized by having all ports read for a 
single thread each cycle. In addition, storage bits can be folded under wires to port access. 

Figures 2 1 and 22 are block diagrams of the integer unit 30 and the compare unit 34, 
35 respectively. Figures 23A and 23B are block diagrams, respectively, of the floating point unit 
32 and the fused multiply-add unit employed therein. The construction and operation of these 
units is evident from the components, interconnections and labelling supplied with the draw- 
ings. . 
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Consumer-Producer Memory 

In prior art multiprocessor systems, the synchronization overhead and programming 
difficulty to implement data-based processing flow between threads or processors (for multiple 
5 steps of image processing for example) is very high. The processor module 5 provides memory 
instructions that permit this to be done easily, enabling threads to wait on the availability of 
data and transparently wake up when another thread indicates the data is available. Such soft- 
ware transparent consumer-producer memory operations enable higher performance fine 
grained thread level parallelism with an efficient data oriented, consumer-producer program- 
10 ming style. 

The illustrated embodiment provides a "Fill" memory instruction, which is used by a 
thread that is a data producer to load data into a selected memory location and to associate a 
state with that location, namely, the "full" state. If the location is already in that state when the 
1 5 instruction is executed, an exception is signalled. 

The embodiment also provides an "Empty" instruction, which is used by a data con- 
sumer to obtain data from a selected location. If the location is associated with the full state, 
the data is read from it (e.g., to a designated register) and the instruction causes the location to 

20 be associated with an "empty" state. Conversely, if the location is not associated with the full 
state at the time the Empty instruction is executed, the instruction causes the thread that exe- 
cuted it to temporarily transition to the idle (or, in an alternative embodiment, an active, non- 
executing) state, re-transitioning it back to the active, executing state — and executing the 
Empty instruction to completion — once it is becomes so associated. Using the Empty instruc- 

25 tion enables a thread to execute when its data is available with low overhead and software 
transparency. 

In the illustrated embodiment, it is the pending (memory) event table (PET) 50 that 
stores status information regarding memory locations that are the subject of Fill and Empty 

30 operations. This includes the addresses of those locations, their respective full or empty states, 
and the identities of the "consumers" of data for those locations, i.e., the threads that have 
executed Empty instructions and are waiting for the locations to fill. It can also include the 
identities of the producers of the data, which can be useful, for example, in signalling and 
tracking causes of exceptions (e.g., as where to successive Fill instructions are executed for the 

35 same address, with no intervening Empty instructions). 

The data for the respective locations is not stored in the PET 50 but, rather, remains in 
the caches and/or memory system itself, just like data that is not the subject of Fill and/or 
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Empty instructions. In other embodiments, the status information is stored in the memory 
system, e.g., alongside the locations to which it pertains and/or in separate tables, linked lists, 
and so forth. 

5 Thus, for example, when an Empty instruction is executed on a given memory location, 

the PET is checked to determine whether it has an entry indicating that same location is cur- 
rently in the full state. If so, that entry is changed to empty and a read is effected, moving data 
from the memory location to the register designated by the Empty instruction. 

10 If, on the other hand, when the Empty instruction is executed, there no entry in the PET 

for the given memory location (or if any such entry indicates that the location is currently 
empty) then an entry is created (or updated) in the PET to indicate that the given location is 
empty and to indicate that the thread which executed the Empty instruction is a consumer for 
any data subsequently stored to that location by a Fill instruction. 

15 

When a Fill instruction is subsequently executed (presumably, by another thread), the 
PET is checked is checked to determine whether it has an entry indicating that same location is 
currently in the empty state. Upon finding such an entry, its state is changed to full, and the 
event delivery mechanism 44 (Figure 4) is used to route a notification to the consumer-thread 

20 identified in that entry. If that thread is in an active, waiting state in a TPU, the notification 
goes to that TPU, which enters active, executing state and reexecutes the Empty instruction — 
this time, to completion (since the memory location is now in the full state). If that thread is in 
the idle state, the notification goes to the system thread (in whatever TPU it is currently execut- 
ing), which causes the thread to be loaded into a TPU in the executing, active state so that the 

25 Empty insruction can be reexecuted. 

In the illustrated embodiment, this use of the PET for consumer/producer-like memory 
operations is only effected with respect to selected memory instructions, e.g., Fill and Empty, 
but not with the more conventional Load and Store memory instructions. Thus, for example, 
30 even if a Load instruction is executed with respect to a memory location that is currently the 
subject of an Empty instruction, no notification is made to the thread that executed that Empty 
instruction so that the instruction can be reexecuted. Other embodiments may vary in this 
regard. 

35 Figures 24A depicts three interdependent threads, 230, 232 and 234, the synchroniza- 

tion of and data transfer between which can be facilitated by Fill and Empty instructions 
according to the invention. By way of example, thread 230 is an MPEG2 demultiplexing 
thread 230, responsible for demultiplexing an MPEG2 signal obtained, for example, from an 
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MPEG2 source 236, e.g., a tuner, a streaming source or otherwise. It is assumed to be in an 
active, executing state on TPU 10, to continue the example. Thread 232 is a video decoding 
Step 1 thread, responsible for a first stage of decoding a video signal from a demultiplexed 
MPEG2 signal. It is assumed to be in an active, executing state on TPU 12. Thread 234 is a 
5 video decoding Step 2 thread, responsible for a second stage of decoding a video signal from a 
demultiplexed MPEG2 signal for output via an LCD interface 238 or other device. It is 
assumed to be in an active, executing state on TPU 14. 

To accommodate data streaming from the source 236 in real-time, each of the threads 
10 230—234 continually process data provided by its upstream source and does so in parallel with 
the other threads. Figure 24B illustrates use of the Fill and Empty instructions to facilitate this 
in a manner which insures synchronization and facilitates data transfer between the threads. 

Referring to the drawing, arrows 240a-240g indicate fill dependencies between the 
15 threads and, particularly, between data locations written to (filled) by one thread and read from 
(emptied) by another thread. Thus, thread 230 processes data destined for address AO, while 
thread 232 executes an Empty instruction targeted to that location and thread 234 executes an 
Empty instruction targeted to address BO (which thread 232 will ultimately Fill). As a result of 
the Empty instructions, thread 232 enters a wait state (e.g., active, non-executing or idle) while 
20 awaiting completion of the Fill of location AO and thread 234 enters a wait state while awaiting 
completion of the Fill of location BO. 

On completion of thread 230's Fill of AO, thread 232's Empty completes, allowing that 
thread to process the data from AO, with the result destined for BO via a Fill instruction. Thread 
25 234 remains in a wait state, still awaiting completion of that Fill. In the meanwhile, thread 230 
begins processing data destined for address A 1 and thread 232 executes the Empty instruction, 
placing it in a wait state while awaiting completion of the Fill of Al. 

When thread 232 executes the Fill demand for BO, thread 234 's Empty completes 
30 allowing that thread to process the data from BO, with the result destined for CO, whence it is 
read by the LCD interface (not shown) for display to the TV viewer.. The three threads 230, 
232, 234 continue process and executing Fill and Empty instruction in this manner — ^as illus- 
trated in the drawing — ^until processing of the entire MPEG2 stream is completed. 

35 A further appreciation of the Fill and Empty instructions may be attained by review of 

their instruction formats. 
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Empty 

Format: ps EMPTY.cache.threads dreg, breg, ireg {,stop} 

5 Description: Empty instructs the memory system to check the state of the effective 

address. If the state is full, empty instruction changes the state to empty and loads the value 
into dreg. If the state is already empty, the instruction waits until the instruction is full, with 
the waiting behavior specified by the thread field. 

10 Operands and Fields: 

ps The predicate source register that specifies whether the instruction is executed. 

If true the instruction is executed, else if false the instruction is not executed (no 
side effects). 



15 



20 



stop 


0 


Specifies that an instruction group is not delineated by this instruction. 




1 


Specifies that an instruction group is delineated by this instruction. 


thread 


0 


unconditional, no thread switch 




1 


unconditional thread switch 




2 


conditional thread switch on stall (block execution of thread) 




3 


reserved 


scache 


0 


tbd with reuse cache hint 




1 


read/write with reuse cache hint 




2 


tbd with no-reuse cache hint 




3 


read/write with no~reuse cache liint 




0 


Specifies index register (ireg) for address calculation 




1 


Specifies disp for address calculation 



ireg Specifies the index register of the instruction. 

breg Specifies the base register of the instruction. 

disp Specifies the two-s complement displacement constant (8-bits) for memory 

reference instructions 

dreg Specifies the destination register of the instruction. 



Fill 

Format: ps FlLL.cache.threads slreg, breg, ireg {,stop} 

35 

Description: Register si reg is written to the word in memory at the effective address. 
The effective address is calculated by adding breg (base register) and either ireg (index register) 
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or disp (displacement) based on the im (immediate memory) field. The state of the effective 
address is changed to full. If the state is already full an exception is signaled. 

Operands and Fields: 

ps The predicate source register that specifies whether the instruction is executed. 

If true the instruction is executed, else if false the instruction is not executed (no 
side effects). 

stop 0 Specifies that an instruction group is not delineated by this instruction. 

1 Specifies that an instruction group is delineated by this instruction. 

thread 0 unconditional, no thread switch 

1 unconditional thread switch 

2 conditional thread switch on stall (block execution of thread) 

3 reserved 

scache 0 tbd with reuse cache hint 

15 1 read /write with reuse cache hint 

2 tbd with no-reuse cache hint 

3 read/ write with no-reuse cache hint 

im 0 Specifies index register (ireg) for address calculation 

1 Specifies disp for address calculation 

ireg Specifies the index register of the instruction. 

breg Specifies the base register of the instruction. 

disp Specifies the two-s complement displacement constant (8-bits) for memory 

reference instructions 



20 



25 



35 



sireg Specifies the register that contains the first operand of the instruction. 



Software Events 



A more complete understanding of the processing of hardware and software events may 
30 be attained by review of their instruction formats: 

Event 

Format: ps EVENT si reg{,stop} 



Description: The EVENT instruction polls the event queue for the executing thread. 
If an event is present the instruction completes with the event status loaded into the exception 
status register. If no event is present in the event queue, the thread transitions to idle state. 
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Operands and Fields: 

ps The predicate source register that specifies whether the instruction is executed. 

If true the instruction is executed, else if false the instruction is not executed (no 
side effects). 

stop 0 Specifies that an instruction group is not delineated by this instruction. 

/ Specifies that an instruction group is delineated by this instruction. 

slre^ Specifies the register that contains the first source operand of the instruction. 



SW Event 

Format: ps SWEVENT s 1 reg{,stop} 

15 Description: The SWEvent instruction en-queues an event, onto the Event Queue to 

be handled by a thread. See xxx for the event format. 

Operands and Fields: 

20 P^ The predicate source register that specifies whether the instruction is executed. 

If true the instruction is executed, else if false the instruction is not executed (no 
side effects). 

stop 0 Specifies that an instruction group is not delineated by this instruction. 

1 Specifies that an instruction group is delineated by this instruction. 

25 sireg Specifies the register that contains the first source operand of the instruction. 



CtlFid 

30 Format: ps.CtlFld.ti cfield, {,stop} 

Description: The Control Field instruction modifies the control field specified by 
cfield. Other fields within the control register are unchanged. 

Operands and Fields: 

ps The predicate source register that specifies whether the instruction is executed. 

If true the instruction is executed, else if false the instruction is not executed (no 
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stop 



ti 



side effects). 

0 Specifies that an instruction group is not delineated by this instruction. 

1 Specifies that an instruction group is delineated by this instruction. 

0 Specifies access to this threads control registers. 

1 Specifies access to control register of thread specified by ID.t_indirect 
field . (thread indirection) (privileged) 



cfield 



cfield[4:0] control field privilege 



OOOnn 


Thread state 


application 


nn value 

00 idle 

01 reserved 

1 0 waiting 

1 1 executing 


OOlOS 


System trap enable 


system 


OOllS 


Application trap enable 


application 


01 COS 


Thread Enable 


system 


OlOlS 


Privilege Level 


System 


Olios 


Registers Modified 


application 


OlllS 


Instruction address translation enable 


system 


lOOOS 


Data address translation enable 


system 


lOOlS 


Alignment Check 


System 


lOlOS 


Endian Mode 


system 


lOllS 
11**S 


reserved 
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S=0 clear, S=l set 
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Devices Incorporating Processor Module S 

Figure 25 is a block diagram of a digital LCD-TV subsystem 242 according to the 
invention embodied in a SoC format. The subsystem 242 includes a processor module 5 con- 
structed as described above and operated to execute simultaneously execute threads providing 
MPEG2 signal demultiplexing, MPEG2 video decoding, MPEG audio decoding, digital-TV 
user interface operation, and operating system execution (e.g,. Linux), e.g., as described above. 
The module 5 is coupled to DDR DRAM flash memory comprising the off-chip portion of the 
L2 cache 26, also as discussed above. The module includes an interface (not shown) to an 
AMBA AHB bus 244, via which it communicates with "intellectual property" or "IP" 246 pro- 
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viding interfaces to other components of the digital LCD-TV, namely, a video input interface, 
a video output interface, an audio output interface and LCD interface. Of course other IP may 
be provided in addition or instead, coupled to the module 5 via the AHB bus 5 or otherwise. 
For example, in the drawing, illustrated module 5 communicates with optional IP via which the 
5 digital LCD-TV obtains source signals and/or is controlled, such as DMA engine 248, high 
speed I/O device controller 250 and low speed device controllers 252 (via APB bridge 254) or 
otherwise. 

Figure 26 is a block diagram of a digital LCD-TV or other application subsystem 256 
10 according to the invention, again, embodied in a SoC format. The illustrated subsystem is 
configured as above, except insofar as it is depicted with APB and AHB/APB bridges and APB 
macros 258 in lieu of the specific IP shown 246 shown in Figure 24. Depending on application 
needs, elements 258 may comprise a video input interface, a video output interface, an audio 
output interface and an LCD interface, as in the implementation above, or otherwise. 

15 

The illustrated subsystem further includes a plurality of modules 5, e.g., from one to 
twenty such modules (or more) that are coupled via an interconnect that interfaces with and, 
preferably, forms part of the off-chip L2 cache 26b utilized by the modules 5. That intercon- 
nect may be in the form of a ring interconnect (Rl) comprising a shift register bus shared by the 

20 modules 5 and, more particularly, by the L2 caches 26. Alternatively, it may be an interconnect 
of another form, proprietary or otherwise, that facilitates the rapid movement of data within the 
combined memory system of the modules 5. Regardless, the L2 caches are preferably coupled 
so that the L2 cache for any one module 5 is not only the memory system for that individual 
processor but also contributes to a distributed all cache memory system for all of the processor 

25 modules 5. Of course, as noted above, the modules 5 do not have to physically sharing the 
same memory system, chips or buses and could, instead, be connected over a network or oth- 
erwise. 

Described above is are apparatus, systems and methods meeting the desired objects. It 
30 will be appreciated that the embodiments described herein are examples of the invention and 
that other embodiments, incorporating changes therein, fall within the scope of the invention, 
of which we claim: 
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